Mhlidd/config inversion #9181

mhlidd · 2025-07-15T20:11:52Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-07-17T20:26:08Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/config_inversion
git_commit_date	1755272433	1755296112
git_commit_sha	`f15598a`	`385a4a4`
release_version	1.53.0-SNAPSHOT~f15598ae39	1.53.0-SNAPSHOT~385a4a446b

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755297958	1755297958
ci_job_id	1083095190	1083095190
ci_pipeline_id	73855339	73855339
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-alogops6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-alogops6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 6 performance improvements and 5 performance regressions! Performance is the same for 38 metrics, 10 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start	worse [+30.189ms; +37.825ms] or [+2.579%; +3.231%]	1.205s	1.171s
scenario:startup:insecure-bank:iast:BytebuddyAgent	worse [+31.183ms; +36.791ms] or [+3.690%; +4.354%]	878.994ms	845.007ms
scenario:startup:insecure-bank:iast:Remote Config	better [-66.041µs; -20.667µs] or [-11.154%; -3.491%]	548.731µs	592.085µs
scenario:startup:insecure-bank:iast:Telemetry	better [-604.464µs; -330.935µs] or [-7.368%; -4.034%]	7.736ms	8.203ms
scenario:startup:insecure-bank:tracing:Remote Config	better [-52.907µs; -14.934µs] or [-8.064%; -2.276%]	622.210µs	656.131µs
scenario:startup:petclinic:appsec:Agent.start	worse [+25.618ms; +35.125ms] or [+2.105%; +2.887%]	1.247s	1.217s
scenario:startup:petclinic:appsec:BytebuddyAgent	worse [+26.268ms; +33.159ms] or [+3.492%; +4.409%]	781.831ms	752.118ms
scenario:startup:petclinic:iast:Remote Config	better [-72.111µs; -21.239µs] or [-12.123%; -3.571%]	548.179µs	594.854µs
scenario:startup:petclinic:iast:Telemetry	better [-1053.787µs; -404.122µs] or [-12.494%; -4.791%]	7.706ms	8.435ms
scenario:startup:petclinic:profiling:BytebuddyAgent	worse [+18.632ms; +41.558ms] or [+2.448%; +5.459%]	791.374ms	761.278ms
scenario:startup:petclinic:tracing:Remote Config	better [-56.201µs; -21.885µs] or [-8.590%; -3.345%]	615.214µs	654.257µs

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~385a4a446b, baseline=1.53.0-SNAPSHOT~f15598ae39

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1054037
Total [baseline] (8.624 s) : 0, 8624283
Agent [candidate] (1.071 s) : 0, 1071043
Total [candidate] (8.634 s) : 0, 8633848
section iast
Agent [baseline] (1.171 s) : 0, 1170586
Total [baseline] (9.32 s) : 0, 9319870
Agent [candidate] (1.205 s) : 0, 1204593
Total [candidate] (9.362 s) : 0, 9361508

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.054 s	-
Agent	iast	1.171 s	116.549 ms (11.1%)
Total	tracing	8.624 s	-
Total	iast	9.32 s	695.587 ms (8.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.071 s	-
Agent	iast	1.205 s	133.55 ms (12.5%)
Total	tracing	8.634 s	-
Total	iast	9.362 s	727.661 ms (8.4%)

gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~385a4a446b, baseline=1.53.0-SNAPSHOT~f15598ae39

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (738.994 ms) : 0, 738994
BytebuddyAgent [candidate] (758.864 ms) : 0, 758864
GlobalTracer [baseline] (243.86 ms) : 0, 243860
GlobalTracer [candidate] (243.984 ms) : 0, 243984
AppSec [baseline] (30.464 ms) : 0, 30464
AppSec [candidate] (29.636 ms) : 0, 29636
Debugger [baseline] (6.046 ms) : 0, 6046
Debugger [candidate] (5.899 ms) : 0, 5899
Remote Config [baseline] (656.131 µs) : 0, 656
Remote Config [candidate] (622.21 µs) : 0, 622
Telemetry [baseline] (11.532 ms) : 0, 11532
Telemetry [candidate] (9.774 ms) : 0, 9774
section iast
crashtracking [baseline] (1.421 ms) : 0, 1421
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (845.007 ms) : 0, 845007
BytebuddyAgent [candidate] (878.994 ms) : 0, 878994
GlobalTracer [baseline] (232.198 ms) : 0, 232198
GlobalTracer [candidate] (233.299 ms) : 0, 233299
IAST [baseline] (28.287 ms) : 0, 28287
IAST [candidate] (30.659 ms) : 0, 30659
AppSec [baseline] (26.625 ms) : 0, 26625
AppSec [candidate] (24.165 ms) : 0, 24165
Debugger [baseline] (7.424 ms) : 0, 7424
Debugger [candidate] (5.449 ms) : 0, 5449
Remote Config [baseline] (592.085 µs) : 0, 592
Remote Config [candidate] (548.731 µs) : 0, 549
Telemetry [baseline] (8.203 ms) : 0, 8203
Telemetry [candidate] (7.736 ms) : 0, 7736

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~385a4a446b, baseline=1.53.0-SNAPSHOT~f15598ae39

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1050340
Total [baseline] (10.701 s) : 0, 10701270
Agent [candidate] (1.073 s) : 0, 1073229
Total [candidate] (10.675 s) : 0, 10675137
section appsec
Agent [baseline] (1.217 s) : 0, 1216763
Total [baseline] (10.743 s) : 0, 10742691
Agent [candidate] (1.247 s) : 0, 1247135
Total [candidate] (10.887 s) : 0, 10886618
section iast
Agent [baseline] (1.191 s) : 0, 1190664
Total [baseline] (10.95 s) : 0, 10949934
Agent [candidate] (1.208 s) : 0, 1208321
Total [candidate] (10.889 s) : 0, 10888976
section profiling
Agent [baseline] (1.195 s) : 0, 1194586
Total [baseline] (10.826 s) : 0, 10825566
Agent [candidate] (1.23 s) : 0, 1230210
Total [candidate] (10.866 s) : 0, 10865735

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.05 s	-
Agent	appsec	1.217 s	166.424 ms (15.8%)
Agent	iast	1.191 s	140.324 ms (13.4%)
Agent	profiling	1.195 s	144.246 ms (13.7%)
Total	tracing	10.701 s	-
Total	appsec	10.743 s	41.421 ms (0.4%)
Total	iast	10.95 s	248.664 ms (2.3%)
Total	profiling	10.826 s	124.296 ms (1.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.073 s	-
Agent	appsec	1.247 s	173.906 ms (16.2%)
Agent	iast	1.208 s	135.092 ms (12.6%)
Agent	profiling	1.23 s	156.98 ms (14.6%)
Total	tracing	10.675 s	-
Total	appsec	10.887 s	211.481 ms (2.0%)
Total	iast	10.889 s	213.84 ms (2.0%)
Total	profiling	10.866 s	190.598 ms (1.8%)

gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~385a4a446b, baseline=1.53.0-SNAPSHOT~f15598ae39

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.437 ms) : 0, 1437
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (736.416 ms) : 0, 736416
BytebuddyAgent [candidate] (759.727 ms) : 0, 759727
GlobalTracer [baseline] (243.042 ms) : 0, 243042
GlobalTracer [candidate] (244.104 ms) : 0, 244104
AppSec [baseline] (30.361 ms) : 0, 30361
AppSec [candidate] (29.574 ms) : 0, 29574
Debugger [baseline] (6.062 ms) : 0, 6062
Debugger [candidate] (5.883 ms) : 0, 5883
Remote Config [baseline] (654.256 µs) : 0, 654
Remote Config [candidate] (615.214 µs) : 0, 615
Telemetry [baseline] (11.32 ms) : 0, 11320
Telemetry [candidate] (9.737 ms) : 0, 9737
section appsec
crashtracking [baseline] (1.416 ms) : 0, 1416
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (752.118 ms) : 0, 752118
BytebuddyAgent [candidate] (781.831 ms) : 0, 781831
GlobalTracer [baseline] (234.1 ms) : 0, 234100
GlobalTracer [candidate] (236.656 ms) : 0, 236656
IAST [baseline] (23.471 ms) : 0, 23471
IAST [candidate] (23.323 ms) : 0, 23323
AppSec [baseline] (168.635 ms) : 0, 168635
AppSec [candidate] (168.435 ms) : 0, 168435
Debugger [baseline] (7.096 ms) : 0, 7096
Debugger [candidate] (5.636 ms) : 0, 5636
Remote Config [baseline] (600.285 µs) : 0, 600
Remote Config [candidate] (610.238 µs) : 0, 610
Telemetry [baseline] (8.313 ms) : 0, 8313
Telemetry [candidate] (8.265 ms) : 0, 8265
section iast
crashtracking [baseline] (1.444 ms) : 0, 1444
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (861.085 ms) : 0, 861085
BytebuddyAgent [candidate] (881.97 ms) : 0, 881970
GlobalTracer [baseline] (235.267 ms) : 0, 235267
GlobalTracer [candidate] (234.002 ms) : 0, 234002
IAST [baseline] (28.624 ms) : 0, 28624
IAST [candidate] (31.598 ms) : 0, 31598
AppSec [baseline] (27.561 ms) : 0, 27561
AppSec [candidate] (24.109 ms) : 0, 24109
Debugger [baseline] (6.604 ms) : 0, 6604
Debugger [candidate] (5.446 ms) : 0, 5446
Remote Config [baseline] (594.854 µs) : 0, 595
Remote Config [candidate] (548.179 µs) : 0, 548
Telemetry [baseline] (8.435 ms) : 0, 8435
Telemetry [candidate] (7.706 ms) : 0, 7706
section profiling
crashtracking [baseline] (1.396 ms) : 0, 1396
crashtracking [candidate] (1.406 ms) : 0, 1406
BytebuddyAgent [baseline] (761.278 ms) : 0, 761278
BytebuddyAgent [candidate] (791.374 ms) : 0, 791374
GlobalTracer [baseline] (221.751 ms) : 0, 221751
GlobalTracer [candidate] (224.894 ms) : 0, 224894
AppSec [baseline] (29.979 ms) : 0, 29979
AppSec [candidate] (30.304 ms) : 0, 30304
Debugger [baseline] (6.285 ms) : 0, 6285
Debugger [candidate] (6.344 ms) : 0, 6344
Remote Config [baseline] (712.334 µs) : 0, 712
Remote Config [candidate] (687.788 µs) : 0, 688
Telemetry [baseline] (16.025 ms) : 0, 16025
Telemetry [candidate] (15.785 ms) : 0, 15785
ProfilingAgent [baseline] (107.743 ms) : 0, 107743
ProfilingAgent [candidate] (109.01 ms) : 0, 109010
Profiling [baseline] (108.387 ms) : 0, 108387
Profiling [candidate] (109.657 ms) : 0, 109657

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/config_inversion
git_commit_date	1755272433	1755296112
git_commit_sha	`f15598a`	`385a4a4`
release_version	1.53.0-SNAPSHOT~f15598ae39	1.53.0-SNAPSHOT~385a4a446b

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755297635	1755297635
ci_job_id	1083095191	1083095191
ci_pipeline_id	73855339	73855339
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-jtvpvcst 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-jtvpvcst 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+169.080µs; +469.052µs] or [+2.029%; +5.629%]	unstable [-91.787op/s; +51.662op/s] or [-16.502%; +9.288%]	8.652ms	536.156op/s	8.333ms	556.219op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+209.117µs; +596.229µs] or [+2.074%; +5.913%]	unstable [-74.007op/s; +38.945op/s] or [-16.068%; +8.455%]	10.486ms	443.062op/s	10.084ms	460.594op/s
scenario:load:petclinic:code_origins:high_load	better [-2.347ms; -1.497ms] or [-5.080%; -3.240%]	unstable [-4.613op/s; +10.825op/s] or [-4.499%; +10.556%]	44.287ms	105.650op/s	46.209ms	102.544op/s
scenario:load:petclinic:appsec:high_load	better [-2.784ms; -1.929ms] or [-5.899%; -4.087%]	unstable [-2.687op/s; +13.062op/s] or [-2.709%; +13.169%]	44.834ms	104.375op/s	47.190ms	99.188op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~385a4a446b, baseline=1.53.0-SNAPSHOT~f15598ae39
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.507 ms) : 4456, 4558
.   : milestone, 4507,
iast (9.401 ms) : 9242, 9560
.   : milestone, 9401,
iast_FULL (13.752 ms) : 13481, 14023
.   : milestone, 13752,
iast_GLOBAL (10.084 ms) : 9911, 10256
.   : milestone, 10084,
profiling (8.333 ms) : 8194, 8472
.   : milestone, 8333,
tracing (7.686 ms) : 7568, 7805
.   : milestone, 7686,
section candidate
no_agent (4.473 ms) : 4416, 4530
.   : milestone, 4473,
iast (9.272 ms) : 9115, 9430
.   : milestone, 9272,
iast_FULL (13.536 ms) : 13269, 13804
.   : milestone, 13536,
iast_GLOBAL (10.486 ms) : 10299, 10673
.   : milestone, 10486,
profiling (8.652 ms) : 8512, 8792
.   : milestone, 8652,
tracing (7.501 ms) : 7396, 7606
.   : milestone, 7501,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.507 ms [4.456 ms, 4.558 ms]	-
iast	9.401 ms [9.242 ms, 9.56 ms]	4.894 ms (108.6%)
iast_FULL	13.752 ms [13.481 ms, 14.023 ms]	9.245 ms (205.1%)
iast_GLOBAL	10.084 ms [9.911 ms, 10.256 ms]	5.576 ms (123.7%)
profiling	8.333 ms [8.194 ms, 8.472 ms]	3.826 ms (84.9%)
tracing	7.686 ms [7.568 ms, 7.805 ms]	3.179 ms (70.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.473 ms [4.416 ms, 4.53 ms]	-
iast	9.272 ms [9.115 ms, 9.43 ms]	4.799 ms (107.3%)
iast_FULL	13.536 ms [13.269 ms, 13.804 ms]	9.063 ms (202.6%)
iast_GLOBAL	10.486 ms [10.299 ms, 10.673 ms]	6.013 ms (134.4%)
profiling	8.652 ms [8.512 ms, 8.792 ms]	4.179 ms (93.4%)
tracing	7.501 ms [7.396 ms, 7.606 ms]	3.028 ms (67.7%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~385a4a446b, baseline=1.53.0-SNAPSHOT~f15598ae39
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.41 ms) : 37101, 37719
.   : milestone, 37410,
appsec (47.19 ms) : 46771, 47609
.   : milestone, 47190,
code_origins (46.209 ms) : 45804, 46615
.   : milestone, 46209,
iast (43.392 ms) : 43009, 43775
.   : milestone, 43392,
profiling (48.161 ms) : 47710, 48613
.   : milestone, 48161,
tracing (44.342 ms) : 43950, 44734
.   : milestone, 44342,
section candidate
no_agent (36.987 ms) : 36694, 37280
.   : milestone, 36987,
appsec (44.834 ms) : 44459, 45208
.   : milestone, 44834,
code_origins (44.287 ms) : 43903, 44671
.   : milestone, 44287,
iast (43.044 ms) : 42667, 43421
.   : milestone, 43044,
profiling (49.525 ms) : 49016, 50034
.   : milestone, 49525,
tracing (44.506 ms) : 44130, 44883
.   : milestone, 44506,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.41 ms [37.101 ms, 37.719 ms]	-
appsec	47.19 ms [46.771 ms, 47.609 ms]	9.78 ms (26.1%)
code_origins	46.209 ms [45.804 ms, 46.615 ms]	8.799 ms (23.5%)
iast	43.392 ms [43.009 ms, 43.775 ms]	5.982 ms (16.0%)
profiling	48.161 ms [47.71 ms, 48.613 ms]	10.751 ms (28.7%)
tracing	44.342 ms [43.95 ms, 44.734 ms]	6.932 ms (18.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.987 ms [36.694 ms, 37.28 ms]	-
appsec	44.834 ms [44.459 ms, 45.208 ms]	7.846 ms (21.2%)
code_origins	44.287 ms [43.903 ms, 44.671 ms]	7.3 ms (19.7%)
iast	43.044 ms [42.667 ms, 43.421 ms]	6.057 ms (16.4%)
profiling	49.525 ms [49.016 ms, 50.034 ms]	12.538 ms (33.9%)
tracing	44.506 ms [44.13 ms, 44.883 ms]	7.519 ms (20.3%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/config_inversion
git_commit_date	1755272433	1755296112
git_commit_sha	`f15598a`	`385a4a4`
release_version	1.53.0-SNAPSHOT~f15598ae39	1.53.0-SNAPSHOT~385a4a446b

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1755298175	1755298175
ci_job_id	1083095192	1083095192
ci_pipeline_id	73855339	73855339
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-hxcryckb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-hxcryckb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.430ms; -1.086ms] or [-38.895%; -29.531%]	2.419ms	3.677ms

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~385a4a446b, baseline=1.53.0-SNAPSHOT~f15598ae39
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.677 ms) : 3456, 3897
.   : milestone, 3677,
iast (2.193 ms) : 2130, 2256
.   : milestone, 2193,
iast_GLOBAL (2.243 ms) : 2180, 2306
.   : milestone, 2243,
profiling (2.059 ms) : 2007, 2111
.   : milestone, 2059,
tracing (2.022 ms) : 1973, 2071
.   : milestone, 2022,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.419 ms) : 2368, 2469
.   : milestone, 2419,
iast (2.262 ms) : 2195, 2328
.   : milestone, 2262,
iast_GLOBAL (2.251 ms) : 2187, 2315
.   : milestone, 2251,
profiling (2.031 ms) : 1980, 2081
.   : milestone, 2031,
tracing (2.022 ms) : 1973, 2072
.   : milestone, 2022,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.465 ms, 1.488 ms]	-
appsec	3.677 ms [3.456 ms, 3.897 ms]	2.201 ms (149.1%)
iast	2.193 ms [2.13 ms, 2.256 ms]	717.133 µs (48.6%)
iast_GLOBAL	2.243 ms [2.18 ms, 2.306 ms]	766.892 µs (52.0%)
profiling	2.059 ms [2.007 ms, 2.111 ms]	583.227 µs (39.5%)
tracing	2.022 ms [1.973 ms, 2.071 ms]	546.001 µs (37.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.459 ms, 1.482 ms]	-
appsec	2.419 ms [2.368 ms, 2.469 ms]	948.012 µs (64.5%)
iast	2.262 ms [2.195 ms, 2.328 ms]	790.931 µs (53.8%)
iast_GLOBAL	2.251 ms [2.187 ms, 2.315 ms]	780.057 µs (53.0%)
profiling	2.031 ms [1.98 ms, 2.081 ms]	559.86 µs (38.1%)
tracing	2.022 ms [1.973 ms, 2.072 ms]	551.776 µs (37.5%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~385a4a446b, baseline=1.53.0-SNAPSHOT~f15598ae39
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.847 s) : 14847000, 14847000
.   : milestone, 14847000,
appsec (14.876 s) : 14876000, 14876000
.   : milestone, 14876000,
iast (18.689 s) : 18689000, 18689000
.   : milestone, 18689000,
iast_GLOBAL (17.785 s) : 17785000, 17785000
.   : milestone, 17785000,
profiling (15.451 s) : 15451000, 15451000
.   : milestone, 15451000,
tracing (14.87 s) : 14870000, 14870000
.   : milestone, 14870000,
section candidate
no_agent (15.396 s) : 15396000, 15396000
.   : milestone, 15396000,
appsec (14.969 s) : 14969000, 14969000
.   : milestone, 14969000,
iast (18.72 s) : 18720000, 18720000
.   : milestone, 18720000,
iast_GLOBAL (18.171 s) : 18171000, 18171000
.   : milestone, 18171000,
profiling (15.642 s) : 15642000, 15642000
.   : milestone, 15642000,
tracing (14.905 s) : 14905000, 14905000
.   : milestone, 14905000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.847 s [14.847 s, 14.847 s]	-
appsec	14.876 s [14.876 s, 14.876 s]	29.0 ms (0.2%)
iast	18.689 s [18.689 s, 18.689 s]	3.842 s (25.9%)
iast_GLOBAL	17.785 s [17.785 s, 17.785 s]	2.938 s (19.8%)
profiling	15.451 s [15.451 s, 15.451 s]	604.0 ms (4.1%)
tracing	14.87 s [14.87 s, 14.87 s]	23.0 ms (0.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.396 s [15.396 s, 15.396 s]	-
appsec	14.969 s [14.969 s, 14.969 s]	-427.0 ms (-2.8%)
iast	18.72 s [18.72 s, 18.72 s]	3.324 s (21.6%)
iast_GLOBAL	18.171 s [18.171 s, 18.171 s]	2.775 s (18.0%)
profiling	15.642 s [15.642 s, 15.642 s]	246.0 ms (1.6%)
tracing	14.905 s [14.905 s, 14.905 s]	-491.0 ms (-3.2%)

datadog-datadog-prod-us1 · 2025-07-31T19:33:46Z

Code coverage: total 55.89%, base diff -1.48%, patch 76.00% (view details)

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 385a4a4 | Docs | Was this helpful? Give us feedback!}

…Configurations, and DD_ linting logger

…ctor

…ponent

mhlidd force-pushed the mhlidd/config_inversion branch 2 times, most recently from 06c162d to f7aaa15 Compare July 17, 2025 20:48

mhlidd changed the base branch from master to project/config_inversion July 18, 2025 18:52

mhlidd changed the base branch from project/config_inversion to master August 7, 2025 13:08

mhlidd added 24 commits August 7, 2025 09:18

saving work

fd62009

init: adding System.getenv forbiddenAPI, ConfigHelper, ParseSupported…

a756eb2

…Configurations, and DD_ linting logger

Fixing java6 incompatibility with EnvironmentVariables component

96e2546

parsing JSON at buildtime

6a87970

fixing invocationtargetexception

b062c96

spotless

6769bda

updating linter to include OTEL_

06ed2fd

adding EnvironmentVariables linter

8dd50e0

adding flag for strictness

9660b1a

updating supported-configurations

f8d2a8c

updated all discoverable configs

b68f0b2

updating jmxfetch configs

dc5d83b

fixing config helper

fe2eeb9

adding unit tests for ConfigHelper

229c38d

fixing tests pt 1

77ddecd

adding configs and updating specific tests to TEST strictness

eb6908a

cleanup and removing system.getenv call

972eef4

adding more supported-configurations

81c12f4

adding more configs

98c57b5

adding configs and updating tests

990c0ce

adding branch coverage

5bdd8cf

updating code coverage again

52c05b4

test

5192a8a

rebasing

f128de8

mhlidd force-pushed the mhlidd/config_inversion branch from 14e02d1 to f128de8 Compare August 7, 2025 15:24

mhlidd added 2 commits August 7, 2025 13:36

adding more configs post-rebase

734f9c7

initialize GeneratedSupportedConfiguratons at buildtime

e9ce233

mhlidd force-pushed the mhlidd/config_inversion branch from 4898aac to e9ce233 Compare August 12, 2025 15:19

mhlidd added 4 commits August 12, 2025 11:26

fixing buildtests

90f536d

adding ConfigInversionStrictStyle

7a1517e

refactor ConfigHelper to datadog.trace.api

5ca61c0

adding configs and updating gradle files to reflect ConfigHelper refa…

abc0b64

…ctor

mhlidd force-pushed the mhlidd/config_inversion branch from 44f437c to abc0b64 Compare August 13, 2025 19:11

mhlidd added 11 commits August 13, 2025 15:16

adding telemetry

97db41f

reverting agent-bootstrap to directly invoke EnvironmentVariables com…

04bde01

…ponent

Merge branch 'master' into mhlidd/config_inversion

9a764c9

updating ConfigHelper to use getAll()

e10e0a9

adding classes to native build time and adding suppressforbidden

340eeef

Adding SupportedConfigurationsSource to buildtime

ea83e25

testing

4b602c1

attempt to fix native image

4bdb960

attempt to fix native build

962490d

cleanup pt1

7299531

Merge branch 'master' into mhlidd/config_inversion

385a4a4

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Mhlidd/config inversion #9181

Mhlidd/config inversion #9181

mhlidd commented Jul 15, 2025

Uh oh!

pr-commenter bot commented Jul 17, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Jul 31, 2025 •

edited by datadog-official bot

Loading

Uh oh!

Uh oh!

Mhlidd/config inversion #9181

Are you sure you want to change the base?

Mhlidd/config inversion #9181

Conversation

mhlidd commented Jul 15, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Jul 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

datadog-datadog-prod-us1 bot commented Jul 31, 2025 • edited by datadog-official bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

pr-commenter bot commented Jul 17, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Jul 31, 2025 •

edited by datadog-official bot

Loading